Local Context-based Recognition of Sketched diagrams
نویسندگان
چکیده
We present a new methodology aimed at the design and implementation of a framework for sketch recognition enabling the recognition and interpretation of diagrams. The diagrams may contain different types of sketched graphic elements such as symbols, connectors, text. Once symbols are distinguished from connectors and identified, the recognition proceeds by identifying the local context of each symbol. This is seen as the symbol interface exposed to the rest of the diagram and includes predefined attachment areas on each symbol. We argue that, in many cases, simple constraints on the local context of each symbol are enough to describe diagram languages defined on those symbols. Further refinement and interpretation of the set of acceptable diagrams is then provided through a visual grammar. We also describe the architecture of the framework and provide sample applications for the domains of flowcharts and binary trees.
منابع مشابه
An agent-based framework for sketched symbol interpretation
Recognizing hand-sketched symbols is a definitely complex problem. The input drawings are often intrinsically ambiguous, and require context to be interpreted in a correct way. Many existing sketch recognition systems avoid this problem by recognizing single segments or simple geometric shapes in a stroke. However, for a recognition system to be effective and precise, context must be exploited,...
متن کاملHand-Drawn Diagram Recognition with Hierarchical Parsing: An Experimental Evaluation
This paper presents the evaluation of a parsing strategy for the recognition of sketched diagrams. The architecture of the recognition system consists of three hierarchically arranged layers where the user’ strokes are first segmented and interpreted as primitive shapes, then by exploiting the domain context they are clustered into symbols of the domain and an interpretation of whole sentence i...
متن کاملEvaluation of Paper-Pen based Sketching Interface
The retrieval and browsing of diagrammatic information extracted from hand-drawn diagrams would open up a rich form of information interaction. However, such sketches currently require handannotations in order to be understood by the computer. While improvements in sketch recognition algorithms have enabled automatic recognition for Tablet PCsketched diagrams, such progress has been constrained...
متن کاملAmbiguity Resolution for Sketched Diagrams by Syntax Analysis Based on Graph Grammars
Sketching, i.e., drawing diagrams by hand and directly on the screen, is gaining popularity, as it is a comfortable and natural way to create and edit diagrams. Hand drawing is inherently imprecise, and often sloppy. As a consequence, when processing hand drawn diagrams with a computer, ambiguities arise: it is not always clear what part of the drawing is meant to represent what component. Reso...
متن کاملVisual Recognition of Sketched Symbols
Diagrams are an essential means of capturing and communicating information in many different domains. They are also a valuable part of the early design process, helping us explore ideas and solutions in an informal environment. This paper presents a new approach to sketched symbol recognition that preserves as much of the visual nature of the symbol as possible. Our method is robust to differen...
متن کامل